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[57] ABSTRACT 

An apparatus and a method are provided for processing a 
user input that is used to drive cursor movement on a display 
in a vehicle that is operating in a turbulent environment. The 
apparatus includes an input device configured to receive the 
user input and generate an input device output signal. The 
apparatus also has a sensing device that is configured to 
detect motion of the vehicle and generate a motion signal 
representing the vehicle motion. A turbulence controller is 
provided for receiving the input device output signal and 
evaluating the motion signal. The turbulence controller 
alters the input device output signal based at least in part 
upon the evaluation of the motion signal such that a com- 
pensated output signal is created for driving the cursor 
movement on the display. 

18 Claims, 3 Drawing Sheets 
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METHODS AND APPARATUS FOR » display in a vehicle that is operating in an unstable 

OPERATING AN INPUT DEVICE IN A environment. The apparatus includes an input device con- 

TURBULENT ENVIRONMENT figured to receive the user input and generate an input device 

output signal. The apparatus also has a sensing device that 

BACKGROUND OF THE INVENTION 5 is configured to detect motion of the vehicle and generate a 

motion signal representing the vehicle motion. A turbulence 

1. Technical Field controller is provided for receiving the input device output 

The present invention generally relates to computer input signal and evaluating the motion signal. The turbulence 

devices and, more particularly, to methods and apparatus for controller alters the input device output signal based at least 

operating an input device in a turbulent environment. jo in part upon the evaluation of the motion signal such that a 

2 Background Information compensated output signal is created for driving the cursor 

The current trend in computer system design is to utilize movement on the display, 

a graphical user interface (GUI) for system access and BRIEF DESCRIPTION OF THE DRAWINGS 
control. When a computer system is configured to operate 

with a GUI, a system user or operator accesses and controls 15 Jq C subject invention will hereinafter be described in 

the functionality of the computer or specific applications conjunction with the appended drawing figures, wherein like 

thereof by manipulating a system generated pointer or cursor numerals denote like elements, and: 

rendered on a display. This manipulation of the cursor is ^ Q j ^ a schematic block diagram of a preferred 

generally accomplished using a computer input device, and em bodiment of the present invention in the context of a 

more common input devices include mice, light pens, graphical user interface (GUI) having an input device for 

trackballs, joysticks, touch pads, or the like. access and operation of an aircraft flight control computer; 

The manipulation of the display cursor using one or more pj G 2 is schematic block diagram of a turbulence con- 

of these input devices is accomplished through user move- trailer according to a preferred embodiment of the present 

ment of the input device across a surface or physical ^ mvcnt i on . am j 

manipulation of a movable or rotatable member of the ' ^ ^ ^ melhod 

device, ms physical action by the operator result ; m a t * environment 

corresponding displacement of die cursor on the screen as a * P * £ embodiment of the present inven- 

motion sensing component of the input device converts the £™ & F r 
action by the user into an appropriate electrical, mechanical, ^ 

or optical signal that is transmitted to the computer for DETAILED DESCRIPTION OF A PREFERRED 

interpretation and subsequent action. In addition, one or EXEMPLARY EMBODIMENT 
more switches of the input device can be actuated by the 

operator to select items from a display menu or to initiate The ensuing description is a preferred exemplary embodi- 

processes of the computer. While these input devices can me nt only, and is not intended to limit the scope, 

provide significant advantages and performance enhance- applicability, or configuration of the invention in any way. 

meats for users, difficulties arise when these devices are Rather, the ensuing descriptions will provide those skilled in 

used in an environment in which external and internal forces the art with a convenient road map for implementing a 

are likely to affect the operators' ability to accurately preferred embodiment of the invention, it being understood 

manipulate the input device. ^ that various changes may be made in the function and 

One such environment in which external and internal arrangement of elements described in an exemplary pre- 

forces are likely to affect the operators' ability to accurately ferred embodiment without departing from the spirit and 

manipulate the input device is in a moving vehicle. GUI use scope of the invention as set forth in the appended claims, 

with a corresponding input device in land, sea, air, and space Referring to FIG. 1, a graphical user interface (GUI) 

vehicles has provided improved functionality, data access 4J system 20 according to a preferred embodiment of the 

and simplicity of use that increases operation efficiency present invention includes an input device 24 configured to 

while reducing operator workload. However, because receive an input 28 from a user 32 and generate an input 

automobiles, ships, aircraft, spacecraft, or the like are sub- device output signal 36 that represents the user's 32 selected 

ject to external forces and disturbances that result in erratic movement of a cursor 40 on a display 44. The system 20 also 

movement of the vehicle and a corresponding jostling of the $Q includes a turbulence controller 48 that receives the input 

operator, undesired movement of the input device is likely to device output signal 36 and a motion signal 52 produced by 

place the cursor in a location of the display that was not a sensing device 56 and representative of the vehicle motion 

intended by the user. In this situation, corrective action is m which the system 20 resides. The turbulence controller 48 

taken by the user to reposition the pointer to the display evaluates the motion signal 52 and generates a compensated 

destination that was originally targeted. Furthermore, if the 5$ output signal 60 that is subsequently transmitted to an 

erratic movement is sustained, input device positioning of interface controller and display driver 64. The interface 

the cursor may be less than optimal and the number of controller and display driver 64 processes the compensated 

repositioning actions taken by the GUI operator is likely to output signal 60 and issues the necessary hardware or 

be greater than desired. Therefore, the benefits of GUI use software signals to the display 44 such that the cursor 40 is 
in a moving vehicle may be diminished unless the effects of 6Q accordingly moved on the display 44. 

the external forces and disturbances are dampened or there j^e input device 24 facilitates communication between 

is compensation for the turbulent environment. me 32 and the display 44, and may comprise any 

_ „ appropriate device or system for controlling the display 44. 

BRIEF SUMMARY OF THE INVENTION descriptioD of ^preferred emboolment, the input 

In accordance with a preferred embodiment of the present 65 device 24 includes a trackball 74 and at least one button 
invention, an apparatus and method are provided for pro- switch 78 mounted within the cockpit of an aircraft (not 
cessing a user input that is used to drive cursor movement on shown). However, the following description of an exem- 
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plary preferred embodiment using a trackball input appara- acceleration magnitude as calculated by the acceleration 

tus and an aircraft as the vehicle in which the GUI system magnitude determinator 122. 

20 is operating should be understood to be illustrative only In the present embodiment, the selection of the gain by the 
and should not be considered to limit the input device 24 and processor 102 is accomplished using a table lookup opera- 
vehicle to a trackball device and aircraft, respectively. More 5 tion of the data structure 110 stored in the memory 106. 
appropriately, it should be understood that the input device More specifically, the acceleration magnitude retrieved by 
24 may be any appropriate input system, such as a mouse, the processor 102 is compared with the acceleration mag- 
light pen joystick, touch pad, or the like, and the mode of nitude data objects 118 until an acceleration magnitude 
transportation may be a land, sea, air or space vehicle that is range containing the calculated acceleration magnitude is 
susceptible to external and internal forces that may affect the 10 found. Once the proper acceleration mam^tude range is 
vehicle operators' ability to accurately manipulate the input identified, a selected gain 134 ^^^^^ 
. ~Y range is selected from the gam data objects 114 based on the 
device 24. selected accelaration magnitude data object 118. This 
With continued reference to FIG. 1 and as previously «e eciea a ^ ^ ^ ^ fa ^ 

indicated, the input device 24 suitably includes one or more receivin ^ me ^ ut d F cvice output signal 3 6. 

movement sensors 68 such as optical, d**ncal. or mcchani- 1S Multi |ication of the ^ device outpu t 36 by the 

cal sensors, to sense the movement of the trackball 74 and selected F gain nA alters the mput device output signal 36. 

activation of the button switch 78. An mput device controller ^ resuUing compensated output signal 60 is presented to 

82 may monitor the state of the movement sensors 68 and mc interface controller and device driver 64 for proper 

generate the input device output signal 36 in a form that is control of the cursor. This allows the scaling factor or 

compatible with the selected communication protocol of the 2 o sensitivity of the input device 24 to be automatically and 

system 20. The input device output signal 36 may be dynamically adjusted by filtering or modifying the input 

produced by an appropriate mechanism using any number of device output signal 36 before it is translated into cursor 

communication formats, for example to represent motion on the display 44. In this way, the cursor moves to 

X-coordinate movement of the trackball 74, Y-coordinate a lesser degree if the motion signal 52 indicates significant 

movement of the trackball 74, and activation/deactrvation of 25 acceleration, causing the turbulence controller 48 to reduce 

the button switches 78. While the input device output signal the gain. Therefore, operation of the input device 24 is 

36 is conventionally directly presented to the interface dampened during periods of erratic vehicle movement that 

controller and display driver 64 for control of the cursor 40 are likely to result in a jostling of the user 32 and a 

across the display 44, the GUI system 20 according to corresponding movement of the input device 24 that places 

various aspects of the present invention provides the input 30 the cursor in an unintended location of the display 44. 

device output signal 36 to the turbulence controller 48 that However, as it should be understood, the apparatus for 

is also suitably receiving motion information detected by the operating the input device 24 in a turbulent envuonment as 

motion sensing device 56. presented may be modified in a wide variety of ways. 

The motion sensing device 56 senses movement associ- For example, each acceleration component (i.e, 

ated with the input device 24. In the present embodiment, the 3s X-component, Y-component, and Z-component) may be 

motion sensing device 56 suitably contains an X-component individually evaluated and only the corresponding compo- 

acceleration sensor 90, AY-component acceleration sensor nent of the input device output signal 36 would be altered. 

94 and AZ-component acceleration sensor 98 for detecting Furthermore, as the movement of the cursor may be two 

the vehicle's acceleration in the X, Y, and Z planes, respeo dimensional (e.g, X-Y), the acceleration components of the 
tivety. The acceleration sensors 90, 94, 98 may be of any 40 two dimensional coordinate system (e.g., X-component 

type, including, but not limited to, spring restrained pendu- acceleration and Y-component acceleration) may be indi- 

lous accelerometers, torque balance pendulous vidually combined with the third acceleration component 

accelerometers, or solid state accelerometers. Each of the (e.g., Z-component) to select an appropriate modification of 

sensors 90, 94, 96 perceives the vehicle's acceleration and the input device output signal 36 as movement of the vehicle 
generates an acceleration reading that is suitably provided as 45 in the third dimension may cause erratic user movement of 

a combined motion signal 52 to the turbulence controller 48 the input device in both of the other two directions (e.g., X 

for evaluation and compensation of the input device output and Y). In addition, the gain may be selected according to 

signal 36 * DV suitable method or criteria. For example, the memory 

The turbulence controller 48 generates a compensated 106 of the turbulence controlled may contain empirically 
output signal 60 based on the input device output signal 36 50 or experimentally derived data that relates any number of 
and the combined motion signal 52. The turbulence control- vehicle movements, duration of the movement, or any other 
ler may comprise any suitable system for generating the quantity corresponding to acceleration of the user 32 or the 
compensated output signal 60, such as a controller, a hard- input device 24 to a gain or delta value that compensates for 
wired circuit, a dedicated chip, a logic array, or another the movement of the input device 24 due to this vehicle 
suitable system. An exemplary turbulence controller 48 is 55 movement Each of these various changes and other modi- 
shown in greater detail in FIG. 2. Referring to FIG. 2, the fications not specifically mentioned may be made m the 
turbulence controller 48 suitably includes: a processor 102; function and arrangement of elements described without 
a memory 106 having a data structure 110 relating gain data departing from the spirit and scope of the invention, 
objects 114 to acceleration magnitude data objects 118; an Furthermore, the method for operating an mput device in a 
acceleration magnitude determinator 122; and a multiplier 60 turbulent environment also provides for these various 
126. During turbulence controller 48 operation, the accel- changes and modifications and the following method should 
eration magnitude determinator 122 receives the motion not to be construed as limiting the order in which the 
signal 52 and calculates the magnitude of the vehicle's individual process steps may be performed and the exem- 
acceleration. The processor 102 retrieves the magnitude of plary process may include more or less steps or may be 
the vehicle's acceleration from the acceleration magnitude 65 performed in the context of a larger processing scheme, 
determinator 122 and accesses the memory 106 for selection Referring to FIG. 3, an exemplary method for operating 
of a correspondence gain data object 114 based upon the an input device in a turbulent environment is presented 
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according to a preferred embodiment of the present inven- 6. The apparatus of claim 1, wherein said sensing device 

tion. Initially, a user input is accepted by an input device includes a plurality of acceleration sensors for detecting the 

(Step 138) and an input device output signal is generated in acceleration components of the vehicle in multiple axes, 

response to the user input accepted by the input device (Step 7. The apparatus of claim 1, further comprising a mag- 

142). A motion signal representing the motion of a vehicle 5 nitude determinator receiving said motion signal from said 

is produced (Step 146) and the input device output signal is sensing device and calculating a magnitude of said motion 

altered based at least in part upon the motion signal such that of ^ c vehicle. 

a compensated output signal is created that for driving g -j^ apparatus of claim 7, further comprising a proces- 

cursor movement on a display (Step 150). sor retrieving said magnitude of said motion of the vehicle 

Although the invention has been described herein in 10 an£ j selecting a gain based thereon, 

conjunction with the appended drawings, those skilled in the 9 xh e apparatus of claim 1, wherein said input device is 

art will appreciate that the scope of the invention is not so a ^c^ball. 

limited. Modifications in the selection, design, and arrange- j^e apparatus of claim 1, wherein said input device is 

ment of the various components and steps discussed herein a mouse 

may be made without departing from the scope of the * 5 11 7^ e ap p ara tus of claim 1, wherein said input device is 

invention as set forth in the appended claims. a tQUch pad 

What is claimed is: 22 The apparatus of claim 1, wherein said input device is 

1. An apparatus for processing a user input that ts used to 

drive cursor movement on a display in a vehicle that is g * ^ q{ ^ a ^ m t ma( * ^ to 

operating in a turbulent environment, comprising the steps *> ^ ^ QQ ^ a vehicle mal * 

of: .... operating in a turbulent environment, comprising the steps 

an input device configured to receive the user input and J£ & 

generate an input device output signal; . . 

6 . fi . , .* . ( a ) accepting the user input with an input device; 

a sensing device configured to detect moUon of the ^ W * v r o 7 . ... 

vehicle and generate a motion signal representing said " (b) generating an input device output signal in response to 

motion of the vehicle; and the user input accepted with said input device; 

a turbulence controller receiving said input device output (c) producing a motion signal representing the motion of 
signal and evaluating said motion signal, said turbu- the vehicle in the turbulent environment; and 
lence controller altering said input device output signal 30 ^ altering said input device output signal based at least 
based at least in part upon said evaluation of said m part upon said motion signal such that a compensated 
motion signal such that a compensated output signal is output signal is created for driving the cursor move- 
created for driving the cursor movement on the display. ment on me 

2. The apparatus of claim 1, further comprising an inter- 14 memo d of c iij m 13, further comprising the step 
face controller and display driver forprocessing said motion 35 of processing said motion signal and issuing commands to 
signal and issuing commands to the display such that the ^ y ^ ^ ^ cufSoris movcd on mc ^phy. 
cursor is moved on the display 15 Thc mcthod of claim 13> wbercin step (c) includes 

3. The apparatus of c aim 1, ^<™*V™™* a move- acceleration of the vehicle. 

ment sensor and a input device controller, said *ovemen ^ ^ 13 (c) 

sensor sensing movement ofsaidinput device and said input 40 AW * t luc "» CUJU " U1 1 > . S,ui^ ™o 

device controller reading the state of said movement sensor detecting the iteration of the chicle in multiply axes 

in order to assist in the production of said input device 17. The method of claim 13, further compr^mg the step 

output signal. of calculating a magnitude of the motion of the vehicle 

4 The apparatus of claim 1, wherein said input device represented by said motion signal, 
output signal represents X-coordinatc movement and 45 18. The method of claim 17, further composing the step 

Y-Component movement of said input device. of retrieving said magnitude and selecting a gain based 

5. The apparatus of claim 1, wherein said sensing device thereon, 
includes an acceleration sensor for detecting thc acceleration 

of the vehicle. * * * * * 
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